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Abstract. Chaotic multiscale dynamical systems are common in many areas of 
science, one of the examples being the interaction of the low-frequency dynam- 
ics in the atmosphere with the fast turbulent weather dynamics. One of the key 
questions about chaotic multiscale systems is how the fast dynamics affects chaos 
at the slow variables, and, therefore, impacts uncertainty and predictability of 
the slow dynamics. Here we demonstrate that the linear slow-fast coupling with 
the total energy conservation property promotes the suppression of chaos at the 
slow variables through the rapid mixing at the fast variables, both theoretically 
and through numerical simulations. A suitable mathematical framework is devel- 
oped, connecting the slow dynamics on the tangent subspaces to the infinite-time 
linear response of the mean state to a constant external forcing at the fast vari- 
ables. Additionally, it is shown that the uncoupled dynamics for the slow vari- 
ables may remain chaotic while the complete multiscale system loses chaos and 
becomes completely predictable at the slow variables through increasing chaos 
and turbulence at the fast variables. This result contradicts the common sense 
intuition, where, naturally, one would think that coupling a slow weakly chaotic 
system with another much faster and much stronger mixing system would result 
in general increase of chaos at the slow variables. 



1. Introduction 

Dynamical systems, where the evolution of variables is separated between two 
or more different time scales, are common in the atmospheric /ocean science, 
physics, chemistry, molecular dynamics, and many other areas. The structure 
of these systems is typically characterized by the existence of a special subset 
of slow variables, which evolve on a much longer time scale than the rest of 
the variables. In particular, one can think of the low-frequency variability mod- 
els in the atmospheric science, where the slow variables, usually the large scale 
empirical orthogonal functions describing the large-scale slowly-varying patterns 
in the atmosphere (such as the Arctic or North Atlantic oscillations, for exam- 
ple), are coupled with small-scale fast processes, which are often very chaotic. 
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turbulent and unpredictable (with respect to the slow time scale, that is). The in- 
clusion of the fast processes often made the direct numerical computation of the 
dynamics on the slow time scale prohibitively expensive in real-world applica- 
tions, which led to the development of multiscale computational methods |12[|14| . 
These methods make use of the averaging formalism f24ll3ni32J to allow for the 
large time discretization steps for the computation of the slow part of the dy- 
namics. Additionally, often the dynamics on the fast time scales are not resolved, 
which requires suitable, often stochastic, parameterizations for the fast dynam- 
ics which are derived from the observed statistics of the fast variables (see, for 
example, ||2T| - |23| and references therein). 

One of the key questions about the behavior of multiscale dynamics, which, 
however, does not seem to be extensively addressed in the literature, is the effect 
of the rapidly mixing turbulent fast dynamics on the chaotic properties of the 
slow variables. Formally, the chaotic behavior of the whole multiscale system is 
determined by its largest Lyapunov characteristic exponent, which often develops 
at fast, strongly chaotic and rapidly mixing variables. However, the largest Lya- 
punov exponent of the whole system does not in practice characterize chaos at 
the slow variables, as it is often observed that the behavior of the slow variables 
can be projected far beyond the Lyapunov time scale of the fast variables. In fact, 
the averaging formalism in 112411311 132| is based on the convergence of the slow 
dynamics to a limit system which does not have any fast variables, and the con- 
vergence occurs for finitely large time intervals despite the fact that the the fast 
dynamics become "infinitely fast" in this limit, and the corresponding Lyapunov 
time scale becomes infinitely short. 

Here we study the chaotic behavior of slow variables by applying the averag- 
ing formalism to the dynamics on the tangent subspaces of the slow variables in 
a two-scale dynamical system. We demonstrate, both analytically and through 
numerical simulations, that, if the linear coupling between the slow and fast 
variables preserves the total energy of the system, the averaged dynamics sys- 
tematically suppresses chaos at the slow variables. It is also speculated that the 
decreased ratio of the autocorrelation time scale to the advection time scale at the 
fast, turbulent and rapidly mixing variables could cause this effect. Remarkably, 
it is observed that the full coupled system can become completely predictable 
and non-chaotic at the slow variables, while the uncoupled dynamics for the slow 
variables alone remain chaotic. The theory is also systematically extended onto 
the explicitly time-dependent and stochastically forced two-scale dynamics. 

The manuscript is organized as follows. In Section |2] we start with a numerical 
experiment with an appropriately rescaled two-scale Lorenz model ||2l [Tn[T4l[T8l , 
which demonstrates that, for only slightly affected one-point statistics such as the 
mean state and variance, the chaos at the slow variables is suppressed by the 
increasing turbulent mixing at the fast variables through the forcing parameter. 
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In Sections |3]-|5] we develop a mathematical framework for the slow averaged dy- 
namics on the tangent subspaces. For the linear energy-preserving deterministic 
coupling, it is shown that chaos at the slow variables is suppressed wherever the 
infinite-time linear response of the mean state of the fast dynamics to a constant 
external forcing is positive definite. It is shown that the positive-definiteness of 
the linear response is governed by the statistical linear stability of the fast dynam- 
ics under sufficiently small external perturbations, which, in turn, seems to be 
implemented by the low ratio of the autocorrelation time to the advection time 
scale at the fast variables. In Section [6] we go back to the Lorenz model and con- 
firm the theoretical predictions by computing the approximate infinite-time linear 
response through the quasi-Gaussian fluctuation-dissipation theorem and observ- 
ing how its increasing positive-definiteness correlates with suppression of chaos at 
the slow variables. In Section [7| we show that it is possible for the uncoupled slow 
dynamics to remain chaotic while the complete system with slow-fast dynamics 
and linear energy-preserving coupling loses chaos and becomes predictable at the 
slow scales by accelerating the turbulent mixing at the fast variables. In Section 
|8] we generalize the developed framework onto the time-dependent and noisy 
dynamics, where the linear energy-preserving coupling may also depend on the 
slow time. Section |9] gives a brief exposition of what happens when the energy- 
preserving coupling is nonlinear in both the slow and fast variables, and has the 
explicit fast time dependence. In Section [10] we show that the developed frame- 
work is also applicable to the multiscale dynamics without the explicit scaling 
parameter e. Section [TT] summarizes the results of this work, as well as outlines 
the future directions of research. 



2. A REMARKABLE BEHAVIOR OF THE TWO-SCALE LORENZ MODEL 

Here we consider a two-scale system of autonomous ordinary differential equa- 
tions of the form 

(2.1) 1J = ^(^'^^)' lf = i^(^'^)' 

where x = x{t) G R^'' are the slow variables, y = y{t) G R^y are the fast 
variables, F and G are Nx and Ny vector-valued functions of x and y, respectively, 
and e ^ 1 is a time-scale separation parameter. 

For the two-scale system in (|2.1|) , one can write the averaged dynamics for x 
alone as e ^ using the formalism from |l2],|24l,|3Tl|32l. The averaging formalism 
produces the averaged system for x in the form 

(2.2) ^ = (F)(x), (F)(x)=/ F(x,z)d^,(z), 
cir J Ax 
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where fix is the invariant probability measure on the attr actor Ax of the limiting 
fast dynamics given by 

dz 

(2.3) _ = G(x,z), 

where z = z{s), while x is a fixed constant parameter for (|2.3|l and, consequently, 
fix- Here we tacitly assume the ergodicity of jix/ well as that (|2.2|) constitutes 



an approximation to (|2.1|) for the finite times in the limit as e — > (for details, 
see |l24ll3TH 32| and references therein). For the above formalism to work, the right- 
hand side of the averaged system in (|2.2|l must not be 0(e), otherwise, higher- 
order homogenization techniques are needed IISTI . 

We choose the two-scale forced damped Lorenz model |IT}|2HTT}[14HT8l for the 
computational study of the dynamical properties of a two-scale slow-fast process 
with generic features of atmospheric dynamics, such as the presence of linearly 
unstable waves, strong nonlinearity, forcing, dissipation, chaos and mixing. The 
two-scale forced damped Lorenz model is given by 

A ^ 

(2.4a) Xi = Xi-i (x/+i - Xj_2) - Xi + Fx - Vi-i' 

J j=i 

\ 

(2.4b) yi,j = - [y/,y+i(y;j_i - yij+2) - yi,j + Fy + XxXi] , 

where 1 < i < Nx, !</</. The following notations are adopted above: 

• X is the set of the slow variables of size Nx- The following periodic bound- 
ary conditions hold for x: = x,; 

• t/ is the set of the fast variables of size Ny = Nx} where / is a positive 
integer. The following boundary conditions hold for y: yi+Nx,i ~ V^'i ^^'^ 

yi,i+] = yi+\,i'' 

• Fx and Fy are the constant forcing parameters; 

• Ax and Ay are the coupling parameters; 

• e is the time scale separation parameter. 

Originally in fTTllTillTSll there was no constant forcing Fy term in the equation 
for y-variables in (|2.4[) , however, in its absence the behavior of the y-variables is 
strongly dissipative |llj|2|]. Here, as in [2], we add a constant forcing Fy in the right- 
hand side of the second equation in (|2.4[) to induce the strongly chaotic behavior 
of the t/-variables with large positive Lyapunov exponents. It is demonstrated 
in mH that the averaging formalism for (|2.4|) is valid. 

In the Lorenz model (|2.4|), Fx and Fy regulate the chaos and mixing of the x and 
y variables, respectively Ill-l6ll20|. However, the mean state and mean energy are 
also affected by the changes in forcing, which affects the mean and energy trends 
in coupling for the fixed coupling parameters. To adjust the effect of coupling 
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independently of forcing, here we perform the rescaling of the Lorenz model as 
in II20II . Consider the uncoupled Lorenz model 

(2.5) = Xi_i{xi+i - Xi-2) -Xi + F 

with the same periodic boundary conditions as above lfT9l . Observe that the long 
term statistical mean state x and the standard deviation /3 in (|2.5|) are the same for 
all Xj due to the translational invariance. Now, we rescale x and t as 

T 

(2.6) Xi = x + ^qi, t = -, 

where the new variables q have zero mean state and unit standard deviation. In 
the rescaled variables, the Lorenz model becomes 

d 1 _ F — X 

(2-7) -^qi = qi-\{qi+\ - qi-i) + j [x{qi+i - qi-i) - qi] + 

where x and /3 are, of course, the functions of F. In addition to setting the mean 
state and variance of qi to zero and one, respectively, due to the time rescaling the 
autocorrelation functions of z acquire identical time scaling for any F (for details, 
see II20I ). 

Here, we similarly rescale the two-scale Lorenz model from (|2.4|) : 

1 F- — X A ^ 
(2.8a) Xi = X/_i(X;+i - Xi_2) + ^ - X;_2) - x,) + ^ ^ 

(2.8b) 

1 

yt,i 



e 



yi,i+iiyt,i-i - yi,i+2) + ^ {yiyi,j-i - ya+i) - yuj) + + a^x, 

Py Py 



where x, y, and j6y are the long term means and variances of the corresponding 
uncoupled system in (|2.5|) with either Fx or Fy set as a constant forcing. Addition- 
ally, we write the fast limiting dynamics for (|2.8|l as 

1 F — z 

(2-9) z/j = z/j+i(z,j_i - Zij+2) + IT (^(Zij-i - Z1J+2) - z/j) + -^iyr~ + ^^^i' 

Py Py 

where x is given as an external parameter, as in (|2.3|) . The rescaling of the model 
implies that the average mean states of x and y are close to zero, and in this case 
the slow averaged system simply becomes the rescaled Lorenz model in (|2.7[) , 
where the right-hand side is 0(1). Therefore, the homogenization techniques 
from ||3n are not needed, just like for the unrescaled Lorenz model in IITIB . 

Below, we show the computed statistics of the rescaled Lorenz model (|2.8|) with 
the following parameters: Nx = 10, Ny = 40, Fx = 6, Fy = 6, 8, 12, 16 and 24, 
Ax = Ay = 0.25, e = 0.01 (the time scale separation between x and y is 100 times). 
The slow forcing parameter F^ = 6 is chosen so that the slow dynamics are not too 
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A T 

Nx = 


-- 10, = 40, f 


X = 6, A 


x = \y = 0.25, e = 0.01 




x-mean 


x-var 


t/-mean 


y-var 


6 


9.64 • 10"^ 


0.9451 


-2.38 • 10-^ 


1.066 


8 


2.817 • 10-2 


0.9514 


-1.466 • 10-2 


1.098 


12 


2.05 • 10-2 


0.9336 


-2.719 • 10-2 


1.139 


16 


-1.353 • 10-2 


0.9006 


-4.028 • 10-2 


1.153 


24 


-6.972 • 10-2 


0.8434 


-6.075 • 10-2 


1.167 



Table 1. The mean states and variances of the x and y variables for 
the rescaled Lorenz model in (|2.8|) with the following parameters: 
= 10, Ny = 40, fx = 6,Fy = 6,8,12,16 and 24, = Ay = 0.25, 
e = 0.01. 



chaotic, mimicking the behavior of low-frequency variability in the atmosphere 
(it is known from the previous work ||Tl-|6l l20B that for F = 6 the dynamics of the 
uncoupled model in (|2.5|) are weakly chaotic). The coupling parameters A^ and Ay 
are set to 0.25 so that they are neither too small, nor too large, to ensure the rich 
interaction between the slow and fast variables without linearizing the rescaled 
Lorenz system too much. The time-scale separation parameter e = 0.01 is, again, 
chosen so that it is neither too large, nor too small (the time scale separation by 
two orders of magnitude is consistent, for instance, with the difference between 
annual and diurnal cycles in the atmosphere). Here and everywhere else, the 
simple 2nd order Runge-Kutta scheme is used to integrate the model in (|2.8|) 
forward in time with the discrete time step = 10-^ and the time averaging 
window of 10000 time units. 

In the rescaled Lorenz model (|2.8|) , it turns out that the values of Fx and Fy do 
not significantly affect the mean state and mean energy for both the slow variables 
X and fast variables y. To show this, in Table [T] we display the mean states and 
variances of both x and y for the rescaled Lorenz model in (|2.8|) . Observe that, 
despite different forcing regimes, the means and variances for both x and y are 
almost unchanged, the mean states being near zero while the variances being near 
one, as designed by the rescaling for the uncoupled model in (|2.7|) . Here note 
that while the rescaling was carried out for the corresponding uncoupled model 
(where it sets the mean state to zero and variance to one precisely), using the same 
rescaling parameters in the coupled model (|2.8|) still sets its means and variances 
near prescribed values zero and one, respectively (although not precisely). 

However, the different values of the fast forcing Fy introduce some changes in 
the statistics (such as the probability density functions and the time autocorrela- 
tion functions) of both the slow variables x of (|2.8|) , and the fast limiting variables z 
of (|2.9|) . To show this, in Figured] we demonstrate the probability density functions 
and the time autocorrelation functions of both x and z (where the free parameter 
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Probability density of Z, N„=10, N„=40 Time autocorrelation of Z, N),=10, N„=40 

F^=6, X^=0.25, A,y=0.25, e=0.01 F^=6, 1^=0.25, ?iy=0.25, e=O.Or 




-4 -3 -2 -1 1 2 3 4 5 10 15 20 

Z Time 



Figure 1. Probability density functions and time autocorrelation 
functions for x of (|2.8[) and z of (|2.9[) (with free parameter x set to 
its mean value) with the following parameters: Nx = 10, Ny = 40, 
Fx = 6, fy = 6,8, 12, 16 and 24, A;, = Ay = 0.25, e = 0.01. 



X is set to its mean value). Observe that in Figure [T] different values of the fast 
forcing Fy do not significantly affect the probability density functions for both x 
and z - they are quite similar with some variations. Perhaps, the most noticeable 
qualitative change can be observed in the time autocorrelation functions for both 
X and z - for smaller values of Fy the time autocorrelation functions of x oscillate 
with somewhat smaller amplitude (which indicates somewhat stronger mixing), 
while the time autocorrelation functions of z display visibly longer decay, which 
indicates weaker mixing. 

Having observed the statistics, we turn our attention to the chaotic behavior of 
the slow variables x for the same range of parameters. As the slow variables x 
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Figure 2. Average divergence between perturbed and unperturbed 
running averages of the slow variables for the rescaled Lorenz model 
in (|2.8|) with the following parameters: Nx = 10, Ny = 40, Fx = 6, 
Fy = 6,8, 12, 16 and 24, A^^ = Ay = 0.25, e = 0.01. 



are coupled to the fast variables y, the straightforward computation of the largest 
Lyapunov exponent will characterize the chaos at the fast variables y, and, there- 
fore, a different method should be used to quantify chaos at the slow variables. 
Here we are going to observe the average divergence behavior in time between 
the short-time (half of the time unit) running averages {x){t) of the slow time 
series x{t), which are initially generated very closely to each other. Namely, we 
perform the following computation: 

• We start with a generic initial condition (xq, t/g)/ ^^1*^ propagate it for 1000 
time units to let it settle on the chaotic attractor of the rescaled Lorenz 
model in (IZ8l) ; 

• A perturbed {x, t/) -state is generated by a small random deviation (of order 
e) from the computed trajectory. Then, the original trajectory x{t) and the 
perturbed state x'{t) are integrated forward in time in parallel. The time 
evolution of the divergence \\{x'){t) — {x){t)\\ between the original and the 
perturbed trajectory is recorded; 

• The latter operation is repeated 500 times with different snapshots of the 
same long-term trajectory, spaced by 20 time units, and averaged. The 
result is the time evolution of the divergence in (x) {t) between the original 
an perturbed trajectory, averaged over the attractor (averaging window of 
10000 time units) of the rescaled Lorenz model in (|2.8|) . 

The short time-averaging window of half of the time unit for the running aver- 
age (x) (t) ensures that the slow variables x{t) do not change much during this 
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Average divergence, N =10, N =40 
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Figure 3. Average divergence between perturbed and unperturbed 
running averages of the slow variables for the rescaled Lorenz model 
in (|2.8|) with the following parameters: Nx = 10, Ny = 40, Fx = 6, 



Fy = 6, 8, 12, 16 and 24, A^, = A„ = 0.25, e = 0.005 and e = 0.001. 



window, while the fast time series y{t) mix completely during the same short 
time averaging window (see the time scales of the time autocorrelation functions 
of X and y in Figure [l] for comparison). The results of this simulation for the 
same set of parameters are shown in Figure |2l Remarkably, the chaos in the slow 
x-variables is consistently suppressed as the fast forcing Fy increases, as the un- 
perturbed and perturbed slow running averages (x) (t) diverge from each other 
slower and slower in time. It cannot be caused by the changing statistical mean 
or variance of the slow or fast variables creating average counteracting forcing at 
the slow variables, as Table [T] clearly indicates that the mean states and variances 
of both the slow and fast variables do not change by a significant amount for dif- 
ferent Fy. This chaos suppression effect at the slow variables appears to become 
somewhat stronger as the time-scale separation is increased: in Figure |3] we show 
the same average divergence as in Figure |2l but with the time-scale separation 
parameter e set to 0.005 and 0.001, respectively. 

In what follows we set out to explain the observed effect of the chaos suppres- 
sion at the slow variables by increasing the turbulent mixing at the fast variables, 
without affecting the mean forcing or variability. As the effect pertains when e 
is decreased, one would expect the averaging formalism ||24ll3nr32il in the limit 
as e — > to provide an approximate way to study the effect from the dynamical 
system perspective, which we systematically develop below. 
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3. A TWO-SCALE SLOW-FAST SYSTEM AND ITS TANGENT LINEAR MODEL FOR THE 

AVERAGED SLOW VARIABLES 

To explain the observations for the two-scale rescaled Lorenz model in the pre- 
vious section, here we study the behavior of the tangent linear model of the av- 
eraged dynamics in (|2.2|) . Below, we do not attempt at rigorous proofs of stated 



claims, instead making reasonable assumptions about the system under consid- 
eration, and justifying the claims under the assumptions made. 

We start by deriving the tangent linear model for (|2.2[) . Here, the necessary 
assumption is that the flow (or, as it is also called, the solution operator) x{t) = 
X{x,t), generated by (|2.2|) , is differentiable with respect to its initial condition x. 
In other words, we assume that the averaged tangent map 

(3.1) TXi=—X{x,t) 
for (|2.2|) exists and is given by the equation 

(3.2) l-TX' = f> (.)TXi. 
The partial derivative in (|3.2|) is given, formally, as 

Above we assume that the invariant measure }ix differentiably depends on x, that 
is, for any ^;^:-measurable /(z) we have 



(3.3) Al{x) = l —{x,z)dMz) + j F{x,z)dii'M 



(3.4) 



/ f{z)d}ix+sx{^)- I f{z)d}ix{z) = 
J Ax J Ax 

= fiz)d}i'Az)^^x + o{\\Sx\\), 



where ji'^ denotes the derivative of fix with respect to x. The differentiability 
property above requires structural stability of fix under changes in x. It is known 
that uniformly hyperbolic diffeomorphisms on the whole R^f (Anosov) or just 
the non wandering set of R^f (Axiom A) are structurally stable l|T3ll26] - |28ll33| . 

Using the linear response theory ||T]-l3ll5l47| |20ll25ll28ll , the second term in (|3.4|) 
can be computed as the infinite-time linear response operator of (|2.3|) for a per- 
turbation of the external parameter x. The calculations are given in the Appendix 
lAl and the result is 

I Ax Jo J Ax 

where (px is the flow, generated by (|2.3|) . For convenience, further we denote 
the left-hand side of the above formula as H{x). Thus, for the averaged tangent 



(3.5) J F{x,z)dii'x{z) = J J —{x,cplz)Tl,—{x,z)dM^)ds, 
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dynamics in (|3.2[) we obtain 



(3.6a) ^TXi ={/ \{x) + H{x) TX^ 



(3.6b) (|)(.) = /^^AF(.,z)d,.(z), 

("00 / r \ 

(3.6c) H{x) = i^J^ —{x,(plz)Tl^,—{x,z)dMz)j ds. 

Under the ergodicity assumption, one can replace the measure averages with the 
time averages: 

(3.7a) (|)w=liml/;AF(.,z(x))dT, 

(3.7b) H(x) = l" (ita 1 j;'|(.,z(T + .))r^,,,,,||(^,z(T))dT) d.. 

4. Deterministic linear coupling with total energy conservation 

It is often the case that the deterministic parts of the coupling in F{x,y) and 
G{x, y) between the slow variables x and the fast variables y allow the total energy 
conservation, as long as in the absence of a random noise the uncoupled dynamics 
preserve the energy separately for x and y. As an example, one can look at the 
model of mean flow - small scale interactions via topographic stress in [16], where 
the total energy conservation in the coupling between the zonal mean flow and 
small scale fluctuations is a key requirement, and topography can be viewed as 
a small parameter. Here we assume that the slow and fast variables are coupled 
through a deterministic coupling with the total energy conservation property. 
More precisely, we let the functions F{x,y) and G{x,y) take the form 

(4.1) F{x,y)= f{x)+f{x,y), G{x,y) = g{y) + g' {x,y), 

and assume that that there exists a symmetric positive definite quadratic form 

(4.2) E = Ex + eEy, Ex = ^x'^SxX, Ey = ^y^Syy, 

where Sx and Sy are constant symmetric positive definite matrices, which is pre- 
served by f'{x, y) and g'{x, y) for any x and y: 

(4.3) x^S,/(x,t/) + y''Syg'{x,y) = 0. 

For (|4.3|) to hold, it is sufficient to have f {x, y) and g'{x, y) in the form 



(4.4a) f{x,y) = S-^'^L{x,y)Sy^y, 
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(4.4b) g\x,y) = -S-^^^L\x,y)Sy\, 

for an arbitrary Nr x Ny matrix-valued function L{x,y). Additionally, if f'{x,y) 
and g'{x,y) are analytic on x R^y, the relations in (|4.4|) are also necessary: 
indeed, in this case f'{x, y) and g'{x, y) can be represented as 

(4.5) f'{x,y)=f'{x,0)+f[{x,y)y, g' {x,y) = g' {0,y) + g[{x,y)x, 

where f'i{x,y)y and g''^{x,y)x represent the Taylor expansion terms above zero 
order in y and x, respectively. As a result, (|4.3)) becomes 



(4.6) 



^xf'i{x,y)+g\{x,yYSy y = -x'^ S^f ix,0) -y^Syg'{0,y), 



where setting either x = or i/ = turns the left-hand side to zero, which 
means that f'{x,0) = g'{0,y) = for any x and y, and that f'{x,y) = fi{x,y)y, 
g'{x,y) = g\{x,y)x. This results in 

(4.7) S,f\{x,y) = -g[ix,yfSy. 
Let L{x,y) and L*{x,y) be given, respectively, by 

(4.8) L{x,y) = Si/V;(x,i/)S-i/2, L*(x,y) = SyYiix,y)S-'/\ 

then, obviously, L*{x,y) = —L{x,yY for any x and y. Therefore, we end up with 

(4.9) f\{x,y) = S-^'^L{x,y)Sy\ g[{x,y) = -S-^'^L" {x,y)Sy^ 



for some Nx x Ny matrix- valued function L{x,y), and (|4.4|) follows directly. 

In this work we study the simplest case of the energy-preserving coupling with 
L{x,y) = L, where L is a constant matrix and does not depend on the variables x 
and y, so that the coupling is linear with respect to y (for the slow variables) and 
X (for the fast variables). With (|4.4|) , (|2.1|) becomes 

dx 



(4.10a) ^ = /(;,) + S-i/2Lsi/V 



(4.10b) ^ = 1 [^(t/) - S-i/^L^sy^;,- 

with the limiting fast dynamics for constant x given by 
(4.11) |=^(z)-S-i/W2x. 

With the above changes, the integral of the time autocorrelation function in (|3.6c[) 
can be written as 



(4.12) H{x) = -S-'/^LSy^ Tl, d^,{z) ds^ Sy'/^L^sV^. 
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The dynamics for the averaged slow tangent map from (|3.6|) is now written as 



(4.13) |rx^ = + fJ(x(0)) TXi. 



Observe that if the slow system in (|4.10a|) is completely decoupled from the fast 



variables (for example, L = 0), then the linear tangent model above loses the term 
H(x), otherwise remaining the same. Below, we study the effect of H{x) on the 
dynamics of (|4.13|) . Observe that H{x) can be written in the form 



(4.14a) H{x) = -S-i/2LSj/2c(x)S-i/2L^Sy2, 

(4.14b) C{x)= / C(x,s)ds, 

Jo 

(4.14c) C(x, s) = Tl, djiM = Inn J dr 

(the last equality is obtained under the ergodicity assumption), where C{x) is 
the infinite time linear response operator of the mean state of (|4.11[) to a constant 
external forcing, with given parameter x (for details, see Appendix iB]). Replacing 
X = Sy^x and y = Sy^y, which are canonical variables for the energy in (|4.2[) 
(that is, the quadratic form in (|4.2|) is diagonal in the new variables x and y), in 
the new variables we obtain 

(4.15) H(x) = -Ld(x)L^. 
Here, 

(4.16) U{x) = Sl^^H{x)S-'^^^ 

is the term H(x) in the canonical energy coordinates, while C{x) is the infinite- 
time mean state linear response operator for (|4.11|) in the canonical energy coor- 
dinates X and y: 

(4.17) d(x) = Sj/2C(x)S-i/2, 



since for z = S\l'^z we have 



(4.18) = Sy^Tl,S-y\ 

5. Suppression of chaos at slow variables by the linear energy-preserving 
coupling for the rapidly decorrelating fast dynamics 

Without loss of generality, further we assume that x and y are already the 
canonical energy variables x and y, as if the dynamical system in (|4.10|| was for- 
mulated in the canonical energy variables from the beginning, such that Sx and 



14 



RAFAIL V. ABRAMOV 



Sy in (|4.2|) are multiples of an identity matrix. With this assumption, the term 
H{x) from (|4.12[) is written as 



(5.1) H{x) = -LC(x)L^ 



where C{x) is given by (|4.14b|) and (|4.14c|) , computed from the fast limiting dy- 
namical system given by 

(5.2) ^ = g{z) - L'x, 

with given parameter x. 

At this point, observe that if H is negative definite, then it has a damping effect 
on the growth of TX^ in (|4.13|) (more generally, in the non-canonical variables 



H reduces the slow energy Ex, promoting the Lyapunov stability). However, 
from (|5.1|) we see that H can only be negative definite whenever C is positive 
definite. Indeed, let v^Hv < for any nonzero v, then, denoting w = LJv, we 
obtain iv^Cw > 0. Below we are going to establish the physical conditions which 
promote the positive-definiteness of C{x). 

First, observe that C{x) is the infinite-time linear response operator for (|5.2|) per- 
turbed by a small constant forcing. In particular, if (|5.2|) is an Ornstein-Uhlenbeck 
process [30J of the form 

(5.3) dz = (h-Tz- L^x) ds + cr dWs, 

with r being positive-definite matrix to (almost) ensure boundedness of the solu- 
tion, then we obtain explicitly 

(5.4a) C{x,s) = C{s) =e-'^, 

(5.4b) C{x) = C= C(s) ds = 





(5.4c) v^Hv = -v^LT-'^L'^v < 0, 

which means that the term H automatically contributes towards the reduction 
of chaos at the slow variables whenever the fast dynamics are modeled by an 
Ornstein-Uhlenbeck process. In general, since 

(5.5) (Sz) = C-df, 

where df is a small constant perturbation, and (cJz) is the infinite-time linear 
response of the mean state (z) of (|5.2|) , the positive-definiteness of C means that 

(5.6) {dz) ■ bf >Q for all sufficiently small bf, 
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that is, the response of the mean state never develops against the perturbation. It 
is not difficult to show that the following identity holds whenever 5f vanishes: 

(5.7) ^^(^Sz) = -5f, 

that is, the time derivative of {5z) at the moment the small constant perturba- 
tion 5f vanishes equals this perturbation with the opposite sign. Therefore, the 
positive-definiteness of C is equivalent to the following mean stability property 
of CT: 

(5.8) ^11^^^) II <0' 

that is, any sufficiently small infinite-time perturbation of the mean state {6z) 
decreases in time at the moment when the external perturbation 6f is removed. 
At present, it is not precisely clear to the author how to ascertain this property 
for general nonlinear g in (|5.2|) , however, one might expect such properties to 
be common in strongly chaotic and mixing turbulent dynamics, as their statisti- 
cal properties are often modeled by an appropriate Ornstein-Uhlenbeck process 
(see | |2TI - |23| and references therein), and, as shown above, the Ornstein-Uhlenbeck 
process satisfies this property automatically. For general nonlinear dynamics, the 
mean stability property must be associated with the situation where the typi- 
cal Poincare recurrence time of nonlinear motion around the mean state in (|5.2[) 
(which can be viewed as an advective time scale) is not much shorter than the tur- 
bulent mixing autocorrelation time. The reason is that, since T^^ = I (the identity 
matrix) for any z, then there always exists a* such that 

ra* 

(5.9) Ca{x) = / C{x,s) ds is positive definite for all a, < a < a*. 

Jo 

The positive-definiteness of Ca{x) for larger a can be violated by the domination 
of the rotation part in C{x,s) for larger s, which evolves on the advective time 
scale of (|5.2[) . However, this effect can be prevented by a rapid decay of ||C(x,s) || 
for large s, which is governed by the turbulent mixing autocorrelation time. Thus, 
in general, one can expect the positive-definiteness of C{x) in the situations where 
the turbulent mixing autocorrelation time scale is not much longer than the ad- 
vective time scale. 

6. Revisiting the rescaled Lorenz model 

Here, after developing the theory for the suppression of chaos at the slow vari- 
ables by the rapidly mixing fast dynamics, we return back to the rescaled Lorenz 
model in (|2.8|| . At this point, we can observe that the rescaled Lorenz model 
in (|2.8|) conforms to the requirements of the theory developed above, with the 
following properties: 
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• The X and y variables in the rescaled Lorenz model are already the canon- 
ical energy variables (up to constant positive factors). Indeed, set all con- 
stant and linear terms in the rescaled Lorenz model in (|2.8)) to zero. Then, 
it is easy to see that the nonlinear parts in x and y separately preserve the 
energies 

(6.1) E. = Y^^l £y = |EEy5. 

while the full rescaled Lorenz model without forcing and dissipation pre- 
serves the total energy of the form 



(6.2) 



A 



i=l 



J 1=1 ]=\ 



Note that x and y in the rescaled Lorenz model are already the canonical 
energy variables, as the quadratic form above is diagonal. 
• The deterministic linear energy-preserving coupling is given by 

/ 



(6.3) 



7=1 



Then, H{x) is given by 
(6.4) H{x) 



^'^'-LCixW. 



J 



(6.5) 



• The rescaled Lorenz model can be written as 

dx ^, , Ay ^ 
- = /(x) + ^Ly, 



(6.6) 



^ = 1 
df £ 

with fix) and ^(y) given by 



1 F — X 

(6.7a) fiix) = Xi_i{xi+i - Xi-2) + {x{xi+i - Xi-2) - x) + , 

Rx Px 



(6.7b) gijiy) = y,,^+i(y;,^_i - y^,j+2) + — {y{yi,j-i - y 1,^+2) - yi,j) + 

Py 



respectively. 
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The slow tangent model dynamics for the rescaled Lorenz model can be 
written as 



(6.8) 



dt 



^(x(0)+Jf(x(0) 



TX 



Overall, it turns out that in the slow-time tangent linear model for the rescaled 
Lorenz system in (|2.8[), the additional term H{x) suppresses chaos at the slow 
variables if the infinite-time linear response operator C{x) of the limiting fast 
dynamics, given by (|4.14b|) and (|4.14c|) , is positive definite. It is, of course, not 
practically feasible to compute C{x,s) directly for all x and s. Here, however, 
we will use a suitable approximation for C{x, s) in the form of the quasi-Gaussian 
linear response operator liT|-|3ll5]-l8U20|. Namely, we approximate the average above 
by the average with respect to the Gaussian distribution p^(z) with the same 
mean state and covariance matrix as }ix [5-2J: 



(6.9a) 



C(x,s) ^ Cg(x,s) = / 



dz, 



(6.9b) pj(z) = exp (^-\{z - z{x)yL-\x){z - z(x))) , 

where z{x) and £(x) are the mean state and covariance matrix, respectively, of 



the fast limiting dynamics in (|5.2[) for fixed x. Then, via integration by parts, one 
can rewrite (|6.9a[) as 



(6.10) 



Cg{x,s) 



l^^^z{s){z-z{x)fp^{z)dz 



[XL 



which after going back to the time averages becomes the time autocorrelation 
function of the form 



(6.11) 



Cg{x,s) 



1 f 

lim - / z(t + s)(z(t) - z(x)y dT 

r^co r Jo 



ixh 



which, after denoting z{t) = z{x) + z'{t), can be written in the form 



(6.12) 



Cg{x,s) 



lim - f z' (t + s)z'^ (t) dT 
r^oo r Jo 



Z-\x). 



Even after the above simplification, it is still not practically feasible to compute 



C{x,s) at many points x, as needed in (|4.13|) . Here, however, we only need to 
observe C{x,s) and C{x) for diagnostic purposes, to relate to the trends in Fig- 
ures |2] and |3l Thus, we compute Cg{x) at the single point x = x, which is the 
long-term mean state of the slow variables in (|2.8|) . Since the motion of the slow 
variables occurs in the vicinity of their mean state, the computed Cq{x) should 
generally reflect the trends happening around that point. In Figure |4] we show the 
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C(x), Nx=10, Ny=40, F^=e, Fy=6, X^=0.25, A^^=0.25, e=0.01 C(x), N^=^0, N =40, F^=e, Fy=8, V0.25, \=0.25, e=0.01 

Smallest eigenvalue is -0.03324 Smallest eigenvalue is 0.1246 




C(x), Nx=10, N =40, Fx=6, Fy=12, ;lj,=0.25, ^y=0.25, £=0.01 C(x), N^^IO, N =40, F^=6, Fy=16, ^0-25, A,y=0.25, £=0.01 
Smallest eigenvalue is 0.2493 Smallest eigenvalue is 0.3621 




C(x), Nx=10, N =40, Fx=6, Fy=24, ;lj,=0.25, A,y=0.25, £=0.01 
Smallest eigenvalue is 0.5032 




Figure 4. Quasi-Gaussian approximations of averaged infinite-time 
linear response operators Cg{x) for the rescaled Lorenz model in 
(|Z8l) with the following parameters: Nx = 10, Ny = 40, fx = 6, 
Fy = 6, 8, 12, 16 and 24, A;, = Ay = 0.25, e = 0.01. 



computed operators Cq{x), together with the smallest eigenvalues of the sym- 
metric parts of those operators (as skew-symmetric parts do not contribute to 
positive-definiteness). Obviously, the larger is the smallest eigenvalue of a sym- 
metric part of the matrix, the "more positive-definite" is the matrix itself. Indeed, 
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Average divergence, N =20, N =80 
F^=6, VO-35, ?iy=0.35, e=0.01 

I Uncoupled' ^ ^ 

F„=6 



O 

0) 
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> 
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CD 
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10 

Time 



Figure 5. Average divergence between perturbed and unperturbed 
running averages of the slow variables for the rescaled Lorenz model 
in (|2.8|) with the following parameters: Nx = 20, Ny = 80, Fx = 6, 

0.01, as well as for the 
= 20 and f = 6. 



Fy = 6,8,12 and 16, Ax = = 0.35, e 
uncoupled rescaled Lorenz model with N 



Nx = 


20, Ny = 80, fx = 6, Ax = \y = 0.35, e = 0.01 


fv 


x-mean 


x-var 


y-mean 


y-var 


6 


6.216 • 10"^ 


0.8878 


-9.982 • 10"^ 


1.119 


8 


2.34 • 10-2 


0.8728 


-2.791 • 10-2 


1.19 


12 


-0.1363 


0.6927 


-5.553 • 10-2 


1.168 


16 


-0.1444 


0.6703 


-8.669 • 10-2 


1.199 



Table 2. The mean states and variances of the x and y variables for 
the rescaled Lorenz model in (|2.8|) with the following parameters: 
Nx = 20, Ny = 80, Fx = 6, Fy = 6, 8, 12 and 16, = Ay = 0.35, 
e = 0.01. 



observe that the smallest eigenvalue of the response systematically increases with 
increased Fy (in fact, for Fy = 6 the operator is not even positive definite). Of 
course, these results are no more than crude estimates of the actual trends, as in 
reality the response operators must be computed for each x and using the exact 
formulas in (|4.14b|) and (|4.14c|) , rather than the one-point estimate under Gaussian 
assumption. Yet, as one can see, even these crude approximations help to connect 
the trends in Figure |4] with the surprising behavior displayed in Figures |2] and |3] 
in Section |2l 
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Probability density of X, N =20, N =80 
Fx=6, X^=0.35, X =0.35, e=0.01 




Time autocorrelation of X, N),=20, N^,=80 
F.=6, ^1^=0.35, \=0.35, e=0.0r 



Probability density of Z, Nj,=20, N^=80 
F^=6, X^=0.35, ?Ly=0.35, e=0.01 



to 
n 
o 




a 

o 
o 
o 



o 

O 
O 
O 




Time 

Time autocorrelation of Z, N„=20, N„=80 
Fx=6, X^=0.35, A,y=0.35, e=0.01 




Figure 6. Probability density functions and time autocorrelation 
functions for x of (|2.8[) and z of (|2.9[) (with free parameter x set to 
its mean value) with the following parameters: Nx = 20, Ny = 80, 
= 6, fy = 6,8, 12 and 16, A;, = Ay = 0.35, e = 0.01. 



7. Complete suppression of chaos at slow variables while the uncoupled 

SLOW dynamics remain chaotic 

One of the key questions in the atmosphere /ocean science is whether the un- 
coupled system, consisting of slow variables only, is more or less chaotic than its 
original version, coupled with the fast, often unresolved or underresolved vari- 
ables. Indeed, often scientists work with uncoupled models consisting of slow 
variables only, where coupling terms were replaced with the estimates of the long- 
term averages of the corresponding fast variables (for example, the T21 barotropic 
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model with the realistic Earth topography |[7l [T5ll29|l ), and study dynamical proper- 
ties of the slow variables in the uncoupled models. The common sense in this case 
suggests that if the uncoupled slow model is chaotic, then, naturally, its original 
version coupled with fast rapidly mixing dynamics should be even more chaotic. 

Remarkably, the common sense logic in this situation is deceiving. In fact, it 
turns out to be possible even to reach the transition from the chaotic to stable 
slow dynamics by increasing the turbulent mixing at the fast variables, while the 
uncoupled slow dynamics remain chaotic. This generally follows from the fact 
that in (|4.13|) the term H is absent from the uncoupled dynamics, and only the 
Jacobian of / remains. Since H acts as a dissipation in (|4.13|) for positive-definite 
infinite-time linear response of the fast variables, it is quite natural that in its 
absence the uncoupled dynamics is more chaotic than the fully coupled dynamics 
at the slow variables. 

Here we demonstrate such an example for the rescaled Lorenz model in (|2.8|) 
with the following set of parameters: Nx = 20, Ny = 80, Fx = 6, = Ay = 0.35, 
£ = 0.01, and compare it with the uncoupled rescaled Lorenz model in (|2.7[) with 
N = 20 and F = 6. In Figure |5] we show the average divergence of a perturbed tra- 
jectory from an unperturbed one for this set of parameters. Observe that, while 
the slow dynamics for Fy = 6,8 and for uncoupled dynamics with F = 6 are 
clearly chaotic, for Fy = 12 and greater values the abrupt transition occurs, where 
the difference between the perturbed and unperturbed x time series does not 
grow much beyond 10%. The statistics for the same set of parameters are shown 
in Figure [6] and Table |2] Here, clearly the correlations and probability densities 
for the slow variables differ significantly for the chaotic and stable regimes, with 
the statistics for the uncoupled Lorenz model with F = 6 being almost identical 
to those for the chaotic regimes with Fy = 6, 8. However, the chaos at slow vari- 
ables is suppressed purely by the dynamical mechanism uncovered in this work; 
indeed, the mean state and variance of both the slow and fast variables do not 
change substantially enough to suppress chaos by creating a counteracting mean 
forcing term at the slow dynamics to suppress Fx (see Table |2] for confirmation), 
while the time autocorrelation functions for the fast variables in Figure [6] with 
X set to the mean state decay faster for larger values of Fy, indicating stronger 
mixing. The key observation here is that the behavior of the uncoupled model 
with only slow variables in the same regime is deceiving - it is clearly chaotic, 
while the full two-scale model loses chaos at the slow variables in more turbulent 
regimes of the fast dynamics. 



8. Generalization onto the two-scale setting with stochastic noise and 

explicit time dependence 

For the simplicity of the presentation, the theory above was developed for a 
simplified setting in (12.1)) , which matched the structure of the two-scale rescaled 
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Lorenz model. However, the real-world chaotic multiscale models often include 
the stochastic noise terms. Additionally, the explicit dependence on the range of 
different time scales is quite common in practice. As an example, one can look at 
the annual and diurnal time scales of the external solar forcing at a given physical 
location on the surface of the Earth. These time scales differ by two orders of 
magnitude. Below we develop the framework for a more general setting, which 
includes both the stochastic noise and explicit dependence on time. 

Here, we modify the dynamical system in (|2.1|) by including the explicit time 
dependence on both the slow time scale t and the fast time scale t/e. Additionally, 
we include the noise terms at both the slow and fast variables. The dynamical 



system in (|2.1[) becomes a system of the Ito stochastic differential equations of the 
form 

(8.1a) dx = F{x, y, t, t/ e) d^ + k{x, t, t/ e) dVt, 

1 1 
(8.1b) dy = -G{x, y, t, t/e) dt + -^(r{y, t, t/e) dWt. 

e y/e 

Above, the terms Vt and Wf are Kx- and -dimensional Wiener processes, re- 
spectively, for some positive integers Kx and Ky, while k{x, t,t/e) and (r{y, t,t/e) 
are the Nx x Kx and Ny x Ky matrix-valued functions, respectively. Observe that 
here k does not depend on y, while cr does not depend on x, as the coupling be- 
tween the slow and fast variables must be deterministic to allow the total energy 
conservation. 

In Section |3] we assumed that both the slow and fast dynamics in (|2.1[) do not 



depend explicitly on time, and that assumption rendered the fast limiting dynam- 
ics in (|2.3[) into autonomous with the invariant distribution measure fix- Since the 
dynamics in (|8.1|) explicitly depend on t/e, the fast limiting dynamics as e — > oo 
(the analogue of that in (|2.3|) ) is non-autonomous: 

(8.2) dz = G(x, z, t, s) ds + (t{z, t, s) dWg. 

Here, x and t are the constant parameters, and the invariant measure ]i for the 
dynamics of z(s) above may no longer exist because of the explicit dependence of 
(|8.2|) on s. However, practice shows that, from the physical perspective, averages 
exist even in a non-autonomous system (where the averaging is assumed to be 
with respect to the time s). Usually, the reason for that is that the way F, G, k and 
cr depend on s is bounded, so, in the limit as s — > oo, these functions "average 
out" over some bounded subset of the phase space, instead of blowing up to 
infinity (as a simplest example, one could think of a periodic dependence on s). 
In Appendix Owe set up a suitable mathematical framework, in which the above 
arguments are arranged in a more formal fashion, through a combination of the 
appropriate skew product flows (see, for example, ©[lOl and references therein). 
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The resulting averaged system is given by 
(8.3a) 



(8.3b) 
(8.3c) 

(8.3d) 
(8.3e) 

(8.3f) 



dx = (F) {x, t) dt + (jc) (x, t) dVt, 

1 r 

(F)(x,t) = lim - / F(x,z(s),t,s) ds 
r^co r Jo 

(K)(x,t)(K)(x,t)^ = lim - / K(x,t,s)K(x,t,s)'^ ds. 
r^co r Jo 

(X, t) + H{X, t) \ dt + 



8F 

dx 



dF 
dx 



(x,t) = lim 



1 rdF 



r-^co r Jo dx 



x,z(s),t,s) ds, 



H(x,t) 



, lim - / —[X,Z[T + S),t,T + S]X 

\^ r^oo r Jo oy 



where T'^'^ ^(^^■^ is the tangent map of (|8.2|l at z(t) to t + s. 

Now, following Section HI we write (|8.1|) in the linear energy-preserving cou- 
pling form: 



(8.4a) 



dx 



f{x, t,t/e) + S~'^^^L{t)Sy^y\ dt + k{x, t,t/e) dVt, 



(8.4b) dy = - g{y,t,t/e) -S~'^^^L'^(t)Sy^x dt + ^ir(y,t,t/e) dWt. 

Here, observe that the linear coupling matrix L may depend on the slow time t, 
L = L(t). With (|8.4[) it is not hard to see that that averaged dynamics for the slow 
tangent map are given by 



dTXl?" 



(8.5a) 



(8.5b) 



(8.5c) 



- S-'^/^L{t)Sy^C{x,t)S-^/^L'^{t)Sy^^ dt+ 



^ d{K)jx,t) 



dx 



^\ (x,t) = lim - / ^(x,t,s)ds, 

dx I r^ca Y Jo dx 

C{x,t) = r ( lim - r T^i I .dr] ds. 



Here we can see that the situation is completely analogous to what was found in 
Sections |4]-(5l that is, the positive-definiteness of C{x,t) in the canonical energy 
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coordinates has a damping effect on the slow averaged tangent dynamics in (|8.5[) , 
thereby reducing chaos at the slow variables. 

9. Nonlinear energy-preserving coupling with dependence on the slow 

and fast variables 

Recall that in Sections |4] and |8] we assumed that the matrix L in the energy 
preserving coupling is either a constant matrix (Section Hj), or is a function of only 
the slow time t (Section H]). However, for the purpose of the energy preservation, 
L can be an arbitrary Nx x Ny matrix function L{x,y,t,t/e). Below we briefly 
outline the situation when L is a function of x, y, t and t/e. 

In such a case, we can extract the slow part L(t) of the energy-preserving cou- 
pling L{x, y, t,t/e) by time-averaging over the fast variables on the trajectory x{t): 



(9.1a) 



1 r 

L(t) = lim - / L( x(t), z(s), t, s) ds, 

r^co r Jo 



(9.1b) L(x, y, t, s) = L{t) + L'{x, y, t, s), 

where x{t) is the solution of (|8.4|) , and z(s) is the solution of (|8.2|) for given x and 
t. Thus, the term L'{x,y, ^,s) in (|9.1|) represents rapid oscillations with zero mean 
state around the slowly varying L{t): 

(9.2) lim - f L'ix{t),zis),t,s)ds = Q. 

r^co r Jo 

With (|9?T1) , the equations in (|8^ become 



(9.3a) 



dx 



f{x,y,t,t/e) + S-'/^L(t)S'J'y 



-1/2, 



dt + K(x, t,t/e) dVt, 



1 r 1 1 

(9.3b) dy = - g{x,y,t,t/e)-Sy^^^L^{t)Sy^x dt + ^(r{y,t,t/e)dWt, 

where we denote 

(9.4a) f{x,y,t,s) = f{x,t,s) + S-^'^L'{x,y,t,s)Sy^y, 

(9.4b) g{x,y,t,s) = g{y,t,s) - S-^'^L'^{x,y,t,s)S\'\ 

With the above changes, the right-hand side of (|C.6|) acquires a new term: 



dTXy 



(9.5a) 



( (I) (^'^^ - s.Ti/^L(os;/^c(x,os-i/2L^(osy2+ 



+ ^ Jf'(x,^,s)^ ds + 



9(k:)(x, 
9x 



dVt 



± ^ V / 
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H'(x, t,s] 



-1/2 



L(t 



lim - 

r— >-oo f 



X,t,z{T 



dx 



x,z(T),t,T) dr 



(9.5b) 



lim - 

r—^co f 



+ lim - 

r— >oo y 



9/ 



z(t) 



dr 



c-l/2 



L^(OSP+ 



{x,z{t + s), t,T + s) Tj;^^^^^ — (x, z(t), i, t) dT. 

It is not known at present how the new term H'(x,t,s) is going to affect the 
dynamics, however, the chaos-suppressing term C{x,t) is nonetheless retained 
by the dynamics. One can presume that if the effect of the new term is small, 
the chaos suppression through C{x,t) would still be observed. At this point, it 
is hardly possible to say anything about the effect of H'{x,t,s) without making 
additional assumptions about its structure. Clearly, the answer to this question 
depends on a particular type of energy-preserving coupling used in the model. 
While a general coupling of the form in (|9.1|) might not necessarily promote the 
suppression of chaos at the slow variables, there could be additional restrictions 
on L'{x, y, t, s) imposed by the physics of a particular model under consideration. 
In the future work, the author intends to derive suitable classes of a more general 
nonlinear energy-preserving coupling which nonetheless promotes the suppres- 
sion of chaos at the slow variables. 



10. InVARIANCE with respect to TIME-SCALING AND INDEPENDENCE OF £ 

Throughout the work, it was presumed that the dependence of the model on 
the time-scale separation parameter e is explicit. However, often in real-world 
situations the parameter e is not present explicitly, but it is known from the obser- 
vations that there is a subset of the "slow" variables in the system, while the rest 
of the variables are "fast". It turns out that the framework, developed here, also 
does not explicitly depend on e. Observe that the averages in (|C.6|) are invariant 



under the time-rescaling of the limiting dynamics in (|8.2[) as 

(10.1) dz = DiG{x,z,t,s) ds + y/DC(r{z,t,s) dWg, 
where a > is an arbitrary parameter. Setting a = yields 

1 1 

(10.2) dz = -G{x,z,t,s) ds + -^(r{z,t,s) dWg, 

e ^J^ 

which is obtained directly from the fast equation in (|8.1b|l by setting x and t as 
constant parameters. Due to this property, the explicit knowledge of the time- 
scale separation parameter e is not necessary; for all practical purposes, one can 
assume that the original slow-fast system in (|8.1)) is supplied without the time- 
scale separation parameter e, in the form 

(10.3a) dx = F(x, y, t, t) dt + k{x, t, t) dVt, 
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(10.3b) dy = G{x, y, t, t) dt + (r{y, t, t) dWt, 

for which it is known, that x is the set of slow variables and y is the set of fast vari- 
ables, and the dependence on the first f-parameter in each function is slow, while 
the dependence on the second ^-parameter is fast. The limiting dynamics in (|8.2|) 
are thus obtained by setting x and first ^-parameter in (|10.3b|) to constants, and 
the averaged slow tangent dynamics in (|C.6|) remain in effect with no corrections. 



11. Summary 

In this work we study the effect of the fast rapidly mixing dynamics on the 
chaos at slow variables in a two-scale system with a deterministic linear energy- 
preserving coupling. A suitable theory is developed by applying the averaging 
formalism to the tangent dynamics of the system, and it is found that the linear 
energy-preserving coupling creates a systematic damping effect on the chaos at 
the slow scales when the fast dynamics is rapidly mixing (the precise criterion 
is the positive-definiteness of the infinite-time linear response to a small constant 
external forcing at the fast scales), which can also be interpreted as the linear 
stability property of the long-term mean state of the fast limiting system under 
the external perturbations. It is suggested that this property must strongly de- 
pend on the ratio of the autocorrelation time and the advection time scale at the 
fast variables, however, a systematic study of this proposition is left for the fu- 
ture work. The effect of the chaos suppression at the slow variables through the 
rapidly mixing fast dynamics is systematically demonstrated for the two-scale 
Lorenz model, which is also appropriately rescaled so that the adjustments for 
the mixing regime at the fast variables do not affect the mean state and variance 
of both the slow and fast variables. In particular, it is shown through the nu- 
merical experiment that the uncoupled slow dynamics, where the fast variables 
are replaced with their averages (which are zeros in the rescaled Lorenz model), 
may remain chaotic, while the full coupled system loses chaos and becomes com- 
pletely predictable at the slow scales as the dynamics at the fast scales become 
more turbulent. The theory is also systematically generalized onto the more gen- 
eral setting with nonautonomous dynamics and stochastic noise at both the slow 
and fast variables. 

Future work. Clearly, the present work, while uncovering a dynamical mech- 
anism for the chaos suppression at the slow variables in a multiscale system, 
does not yet provide any systematic quantification of the chaos suppression ef- 
fect, which will have to be addressed in the future work. Below we sketch a few 
key directions, immediately emerging from the results of the present study. 
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• Is there a simple direct quantitative connection between the chaos at 
the slow variables and the infinite-time linear response at the fast vari- 
ables? Above, while the dynamical mechanism of the chaos suppression 

is discussed, no quantitative connections between the Lyapunov charac- 
teristic exponents of the slow averaged dynamics and the eigenvalues of 
the symmetric part of the infinite-time linear response at the fast variables 
are investigated. Are there any simple direct estimates of the chaos re- 
duction at the slow variables through the autocorrelation times of the fast 
variables? 

• Is it possible to estimate the chaos suppression effect from the autocor^ 
relation time/advection time scale ratio? Above we briefly formulated the 

hypothesis that the suppression of chaos at the slow variables could be 
amplified by a large ratio of the advection time scale to the autocorrelation 
time at the fast variables. If this hypothesis is correct, would it be possible 
to make an estimate of the chaos suppression effect by knowing the ratio 
of the advection time scale to the autocorrelation time, perhaps through 
the theory of turbulence? 

• What if the energy-preserving coupling is nonlinear? We briefly sketched 
that if the energy-preserving coupling is nonlinear, then an additional term 
appears in the dynamics of the slow averaged tangent map, and it is not 
immediately clear whether it would create a damping or amplifying slow 
chaos effect. Can one identify suitable physically relevant classes of non- 
linear coupling which suppresses chaos at the slow variables? 

• What happens in more sophisticated models? Are the fully coupled mod- 
els less chaotic at the slow variables than the uncoupled low-frequency 
variability models? If so, could the global climate be generally less chaotic 
than we presently tend to think? Could the predictive skill be improved 
by appropriately adjusting the uncoupled models to match the slow chaos 
properties of the coupled dynamics? 

The author intends to address these problems in the future work, possibly in 
collaboration with atmospheric scientists. 
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Appendix A. Infinite time linear response to changes in x 
Let }ix be an invariant measure for the dynamics given by 

dz 

(A.1) —^Gix^z) 
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with flow (pi^ and ergodic attractor Ax, where x is a flxed parameter. Let B{z) be 
a differentiable function of z, and let {B)x denote the average 



(A.2) 



(B) 



A: 



B{z)d}ix{z). 



Our goal here is to compute the derivative of {B)x with respect to x (if it exists): 

d{B)x 



{A3) 



dx 



A. 



B{z)diiUz). 



Here we are going to use the linear response theory from [[T]-l3ll5]47l l20ll25ll28| . Let 
us assume that, at the initial time t = 0, there is a statistical ensemble of points z, 
distributed according to }ix, and, at the same time, there is a change x + Sxin (|A.1|) . 
Then, one can treat the difference between the averages along the perturbed and 
unperturbed trajectories of (|A.1[) , emerging from the initial statistical ensemble, 
as time goes to infinity, as the derivative in (|A.3|) : 

B{z) dfi'^{z)Sx + 0{\\Sxf) = 



(A.4) 



A^ 



lim 



Wx+s.^) - B{cpiz)] dfixi^)- 

J Ax 

For the above relation to hold, the structural stability of }ix under the changes 
in X is required. It is known that uniformly hyperbolic diffeomorphisms on the 
whole phase space of (|A.1|) (Anosov) or just its nonwandering set (Axiom A) are 
structurally stable [13u26ti28u33il . The integral in the right-hand side above is given 
by 



(A.5) 



A, 



[B{<Px+s.^) - Bi<piz)] dH.(z) 



Ax 



VB{cpiz)-cpiz 



d}ix{z)Sx + 0{\\Sx\ 



To compute the derivative of the flow cpl^z in x, we use the fact that it is a solution 
of (|A.1|I , and, therefore, satisfies 



(A.6) 



-(piz = G{x,(p[z), 



Subtracting one identity from another and Taylor-expanding in Sx, we obtain 

T, {t/'^) = f +|^(.,^iz) + o(||fa||). 

By sending Sx to zero, the formal solution to the above equation with zero initial 
condition is given by the Duhamel's principle: 



(A.8) 
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where ^ is the tangent map of (p^^z 



(A.9) 

satisfying 
(A.10) 



■ x,z 



dz 



— {x,cplz)Ti^, 



Substituting the above equation into (|A.5|) , we obtain 



(A.ll) 



Ax 



JA: 



dG 



d}ix{z) dsSx + 0(||^x| 



By using the fact that fix is the invariant measure for (pl^, we obtain 
[B{cpi+sx^) - B{cpiz)] diix{^) = 



Ax 



(A.12) 



t 

JAx 
t 



dG 



J A 



VB{<p^-'z)r-i—{x,z 
'^B{fxz)n^,^{x,z) 



d}ix{z) ds5x + 0{\\Sx\\^] 
dfix{z) dsSx + 0{\\Sx\\'^). 



Comparing the above relation with (|A.4|) , we obtain, as Sx — > 0, 



(A.13) 



Ax 



B{z)dii'Az) 



J A 



VB{<PIz)tJ-^{x,z) 



d}ix{z) ds. 



By using ergodicity of }ix, we can replace the measure averages above with time 

averages over a long-term trajectory z{t) of (|A.1|) : 

(A.14) 



B{z)du'Jz) = lim - 

Ax Jo V™ r Jo 



VB{z{t + s))T 



dG_ 



(x,z(t)) 



dr ds. 



In terms of the linear response theory Ill]43ll5]47l l20ll25ll28i , the above expression is 
the infinite time linear response of (B) to the changes in x. 

Appendix B. Infinite time linear response of the mean state to constant 

ADDITIVE perturbation 



(B.l) 



Let ji be an invariant measure for the dynamics given by 

dz 
dt 



G(z) 
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with flow (p'^ and ergodic attractor A. Let (z) be the mean state of (|B.1[) : 
(B.2) (z) = / zdii{z). 



A 



Now, assume that (IB.l)) is perturbed by a constant additive perturbation Sf, 



(B.3) ^ = G(z) + <5/, 

with perturbed flow given by (p*K Our goal here is to compute the infinite time 
linear response of (z). Following Appendix lAl we write 

(B.4) |(/)^z = Gicp'z), ^^cp*'z = Gicp^'z) + 5f. 

Let the difference between the perturbed and unperturbed flows be given as Scp^z. 
Now, taking the difference between the two relations above, we obtain 

3) lliH'^) = G{<p'z + 5<p'z) - G{<p'z) + 3f = 

= VG{(p^z)5(p^z + Sf + 0{p(p^zf). 
Neglecting the higher-order term, we obtain, through the Duhamel's principle, 

(B.6) 3(p^z= ^Tldsdf, 

Jo 



where is the tangent map of (|B.1|) , given by 



(B.7) |n = VG((/)'z)n- 

Then, by integrating over fi and taking i — ^ oo, for the infinite time response of 
(z) we obtain 

(B.8) S{z) = / / Tldu{z)dsSf. 

Jo J A 

Assuming ergodicity of }i and replacing measure average with time average over 
a long-term trajectory z{t) of (|B.1|) , we obtain 

(B.9) ^(z>=/^"(liml/;r;,„dT)ds^/. 

Appendix C. Averaged dynamics with explicit time dependence 

Here, we assume that the fast limiting system in (|8.2[) , which includes both the 
s-dependent Wiener process Wg and the explicit s-dependence of G and tr, can be 
expressed as a collection of the following dynamical systems: 
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• A flow 0^ : Q — > Q on a measurable space Q with a distribution measure 
p, where s is the time parameter. The elements q ^ Q play the role of a 
bounded pseudo-"time" in the deterministic time-dependence of F, G, k 
and cr. 9^ has the following properties: 

- The semigroup property - 6^ = I, 6^6^ = 6^^^; 

- 6 is measure-preserving: p{Q) = p{6^Q) for any subset Q C Q. 

• A base flow i?^ : O — > O, given over a probability space {O, P} (this 
probability space documents all realizations of the Wiener process Ws{co)). 
The idea of this dynamical system is to "fast-forward" or "rewind" Ws{co) 
as needed by specifying the time parameter s. J?^ has the following prop- 
erties: 

- The semigroup property - = I, d^d^ = d^^^; 

- If A G then d^A is also in T for any s; 

- Measure preservation: P(A) = W{d^ A) for any s; 

- The Wiener process Ws{co) satisfies Wr^d^co) = Ws+r{co) — Ws{co). 

• AO, j?-cocycle : R^v R^v with properties 

which represents a solution of the non-autonomous fast limiting system in 

Now, instead of considering a still compact global attractor Ax for the autonomous 
dynamics like in Section |3] (which parametrically depends on the slow variables x), 
here we consider a q, a;-dependent family of compact global puUback-attracting 
sets Ax t{q,<^) C R^y, which is 9, i?-invariant, that is, 
(C.2) 

(pl'^''Ax,t{(]'^) = AxA^'^J''^'^)' }^d^st{Ax,t{(1'^)'(pl,t'^'^ '^''^) =0' 

for all q ^ Q, P-almost all a; G O, and all compact subsets 8 of R^y, where dist 
is the Hausdorff distance in R^y. Then, the family of sets Ax,tiq,<^) is called the 
global puUback attractor of (|8.2|) . Similarly, instead of a single invariant measure 
fix one can consider a family of 0, i?-in variant measures ^^'^ on Ax,t{q,CL>), with 
the property 

(C.3) = /xf'^i^)' VA c AxA^^cv). 

At this point, let 



(C.4) 



F{x,z,t,9'qo) = F{x,z,t,s), 
k{x,t,6^qQ) = K{x,t,s), 



G{x,z,t,6^qo) = G{x,z,t,s), 
d-(z,t,e'qo) = cr(z,t,s), 
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for all X, t, z, s and some qo G Q, which corresponds to the zero time s = 0. Now, 
the slow limiting averaged system for (|8.1|) is given by 



(C.5a) 
(C.5b) 

(C.5c) 



dx = (F) (x, t) dt + (k) (x, t) dVt, 



{F){x,t) 



F{x,z, t,q) d^^'J(z) dP(a;) dp{q), 



{K){x,t){K){x,tY = / k{x,t,q)k{x,t,qY dp{q) 

JQ 



If J 
lim - / K{x,t,s)K{x,t,s) ds. 
r^oo r Jo 



Here we assume that the cocycle in (|C.1|) , which is a stochastic flow in s, is differ- 



entiable with respect to its initial condition ||T7|, and, therefore, the corresponding 



equations for the averaged slow tangent map in (|3.6|) are given by 

dF 
dx 



(C.6a) 

(C.6b) 
(C.6c) 



dTX^O'^ 



X, t) + H(x, t)\ dt+ ^^'^[^'''^'^ dVt 



dx 



— 
ax 



dp 



H(x,t) 



F{x,z,t,q)d}i'^f{z)dF{cv)dp{q), 

' Q Jn J Ax,t{q,co) 

where }i' is the derivative of }i with respect to the parameter x. Observe that now 



the solution of (|C.5|) , starting from a point z, is given by the cocycle (p: 
(C.7) z(s) = ^l^'z, 

where q and OJ denote parametric dependence on the starting time and probability 
space outcome for the Wiener process Ws{co), which means that (p satisfies 

(C.8) d(/)J?-'''z = Gix,(p^^^''z,t,e'q) ds + ^{(p^^^''z,t,e'q) dWs{cv). 

Now, let us denote the tangent map of the cocycle (p as 

(C.9) f J- = lcpi-'\ 

which obviously obeys the chain rule 



(CIO) T^xr = ti;-;, y{q,co) g (q,q) 

and satisfies the equation 



(C.ll) dfJX^ 



^-^{x,<p^';'z,t,e'q) ds + "^(^P'^'z^t^e^q) dWs{cv) 



da 



q,co,s ^ 



-* x,t,z ■ 
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Then, through the Duhamel's principle, the x-derivative of (p after elapsed time a 
is computed as 

while the average linear response of F to the changes in which is after the 
elapsed time a since x was changed, is given, in the puUback sense, as 



(C.13) 



,q,LO,s—a , /is— fl \ 1 y "Qi^ "i-^ r \ -i 

x — {x,(pl'^' z,t,9'' ""qjAji^^i^' (z) ds. 



f F{x,z,t,q)dfiJ\ (z) = / / T—{x,z,t,q)T ^ la,,s-a ' x 

After applying (|C.3|) , the above formula becomes 



(C.14) 

The further average over p and P yields 
(C.15) 

F{x,z,t,q) d}i^'^{z) dP(a;) dp{q) = 



jQJciJA^,,{e'-<'q,d'-''co)dz^ ^"^'^ 
X —{x,z,t,9^~''q)d}^^ ^ ^' (z) dP(a;) d|0(i^) ds, 

where, after using the invariance of p and P under 9 and i?, respectively, and 
replacing a — s with s in the integral over s, finally obtain 

'x,t ( 

(C.16) =r[ [ [ ^P{x,<p^'^''z,t,9'q)x 



F{x,z,t,q) d}i^\ {z)dV{co)dp{q) 

Q Jn JAx,t{q,Lo) 
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Then the term H{x,t) in (|C.6|) is formally given by sending the response time a in 
the formula above to infinity: 



(C.17) 



Jo JQJcLJAr,M,co)dz 
xTiTz^G{x,z,t,q) d/^{z) dP(a;) d^^) ds. 



The assumption of the joint ergodicity of Q and O is that a sufficiently long 
trajectory s completely samples Q and O through and d^, respectively, with 
the corresponding statistical weights given by the product of the measures p and 
P. Under this assumption, one can replace the measure averages with the time 
averages, leading to (|8.3[) . 
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